Started presentation for system demo.
Lots of meetings.
Finished setting up proxy/certbot.
Lots of meetings in PM.
Added some more logic for uploads to datalake from replication tests, specifically failure mechanisms.
Initially registered domain skasrc.uk, but was informed by Richard (S) to use a subdomain, skadev.skatelescope.org.
This is now working, and cloud-support at STFC have opened up 443. Will need to configure NGINX next.
Some dashboards work (adding upload matrix + layout).
Emailed Sam Lloyd re: policy about registering new domains (required for HTTPS using letsencrypt).
This is done:
[root@8850555c228f ~]# rucio list-dids SKA_SKAO_TEAM:* --filter type=all
+----------------------------------------+--------------+
| SCOPE:NAME | [DID TYPE] |
|----------------------------------------+--------------|
| SKA_SKAO_TEAM:PrimaryBeam_B2.fits | FILE |
| SKA_SKAO_TEAM:True_560_v2.txt | FILE |
| SKA_SKAO_TEAM:True_1400_v2.txt | FILE |
| SKA_SKAO_TEAM:PrimaryBeam_B1.fits | FILE |
| SKA_SKAO_TEAM:SKAMid_B1_1000h_v3.fits | FILE |
| SKA_SKAO_TEAM:TrainingSet_B1_v2_ML.txt | FILE |
| SKA_SKAO_TEAM:TrainingSet_B2_v2_ML.txt | FILE |
| SKA_SKAO_TEAM:SKAMid_B5_1000h_v3.fits | FILE |
| SKA_SKAO_TEAM:True_9200_v2.txt | FILE |
| SKA_SKAO_TEAM:SKAMid_B2_1000h_v3.fits | FILE |
| SKA_SKAO_TEAM:PrimaryBeam_B5.fits | FILE |
| SKA_SKAO_TEAM:TrainingSet_B5_v2_ML.txt | FILE |
+----------------------------------------+--------------+PM off (toil)
Presented Rucio jupyterlab extension work to WP5 group meeting.
Finished presentation/demo for WP5 meeting.
Logs now piped to /var/log/cron using redirects in the cron script. Logrotated daily.
Been asked by Yan G. to contribute to presentation re: rucio jupyterlab extension at WP5 meeting (Monday), so started looking at this.
WP2 meeting presentation.
Working on logging for rucio-analysis.
A lot of meetings.
Jupyterhub instance needed to be flicked to "lab" mode not the default, "tree". Required changing default URL.
Added in ESCAPE credentials and copied over my X.509 certificate to test download etc. All works.
Some debugging of problem with jupyterhub server.
Created a docker repository on src-docker-registry.
Created new notebook spec on escape instance, but couldn't get the docker registry to resolve, so used the one at projectescape for now:
- display_name: "ESCAPE rucio datalake notebook"
description: "ESCAPE enabled rucio datalake notebook"
kubespawner_override:
image: projectescape/rucio-jupyterhubThis works, but nothing shows.
Few meetings.
Container built with auth & works. Spoke with Rohini/Alex about deployment to cluster as notebook, but didn't have access.
Also, how to handle X509?
Looked at dashboard workflow. Added alerts to graph.
Auth error.
A lot of varied meetings.
Looked at docs. Recreating docker image.
Remade the world map transfer plot for Rizart.
Fixed src-proxy redirects & exposed cluster es/influx so can add auxiliary datasource for use in rucio events dashboard (can keep RSEs/scopes dynamic). This is live on: 130.246.214.144:80
Induction, ops walk in afternoon.
Induction, IOP meetings.
Adding gfal2 to rucio-client image.
Added rucio-analysis to DockerHub CI
WP2 meeting in morning. Induction in afternoon.
Finished adding API to rucio-analysis. Missing QOS upload. Asked James to review.
Amended dashboard to add src/dst RSE.
Looked at adding API to rucio-analysis.
Added events v time panel to dashboard (not that you can actually see anything at the moment!)
Went for ops walk in afternoon.
Science sim meetings.
Finished setting up new k8s server for monitoring. Still needs PV.
Rizart is still working on this & has taken down the hermes daemon. As a result, no events from either cronjobs are appearing on the dashboard.
Once he is done, we will need to switch the floating IP over to escape-datalake-monitoring-head (migrating to new k8s server) and get him to change the datasource from 130.246.215.38:8086/ to 130.246.215.38:8086/monit
This should just work without any further changes, as shown below:
rbarnsley@src-dmz:~$ curl src-proxy:8086/monit/health
{"checks":[],"message":"ready for queries and writes","name":"influxdb","status":"pass","version":"1.8.0"}